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(54) internet^nabled graphical user ^ 

world-wide web documents and an Integrated web browser 



(57) A graphical user interface is disclosed that con- 
sists of a toolbar and toolbar icons that can be directly 
linked to Web documents containing references to Java 
applets or data files that collectively implement the func- 
tions associated with the icons. The Web documents 
and/or the referenced objects can be remote (i.e., ac- 
cessible over the Internet) or local (directly accessible 
via the operating system of the computer displaying the 
GUI). The graphical user interface is linked to Web 
browser software so that, whenever a toolbar icon is se- 
lected, the interface triggers the Web browser to load 
the Web document linked to the selected icon. Once this 
occurs, the Web browser automatically toads the files 
referenced by the Web document and then executes 
those of the loaded fties that are executable (i.e., Java 
applets or standalone programs). In a preferred embod- 
iment, each toolbar icon is linked to a single applet (re- 
mote or local) that implements the icon's functions. Due 
to the linkage between an icon's associated Web docu- 
ment and the Web browser, the icon's associated applet 
is executed automatically whenever the icon is selected. 
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Description 

their linked icon is selected. 
BACKGROUND OF THE INVENTION 

wfth computer programs and files. The typ^a I GUI £"^ a „£££ ^ accessed , rom the controlling program. A 
operation provided by the program xorrtro hn 9 1 to ^ a *™ J wrth a moU se) the appropriate icon. For 
user wanting to initiate an operate Irom the GUI «»» 60 "J ' TJ™ JV^ ? a^umenX bv selecting the spell checking 
exanp.e.auserdawordpro^ 

icon from the word f^ 1 -"^^ to ^ pTieTg'he destination directory and then dropping (dese- 

computer hosting the operating system or applicator, P r0 9™ »^ ,nstead. in 

ample, that an icon cannot be 

can be executed on the local system. i„w a r» that allows icons to be linked to remote objects, such as 

Therefore, there is a new for a grapnel us ^ ,n ' erfac ^^'X^u°ed using the services of the operating 
programsorfi.es, soth-atlhe*^^^ 

system orapplication delaying the con. There is _sucn g 

guarantees ^the = ic^ 

HTML documents andcc^mun^™ 

this is done by the user select ng a hyperte* ' '™ ^ browser ^ j^es a HTTP (hypertext 

phrase) within a document being X^^Medby^ requested document's URL 

other than those resources which the user exphcrt* ^. a ^^^^S^Sub browser running 
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SUMMARY OF THE INVENTION 

BRIEF DESCRIPTION OF THE DRAWINGS 

some of the displayed components are local or remoi 
DESCRIPTION OF THE PREFERRED EMBODIMENT 

Referr, g toFi 9 ure1,there^ 
r io^eS Computer 102 includes a processor iWa^^l 108. The computers 102 operate mo 
JiS^S secondary!^ 
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tSOAhasan integrated JWS Browser 

remote (stored apart from the user's machine or local " eto0 ^°™t s - 

£Li to be assembted that ^Tl^o^^Z^ the components of a portoPo. 

The term 'projects' is defined for the P«P°««e* *» inS™ with mixed objects, such as a portfolio con- 
The user interface of the present invention faolrtates user rtenclni ™ J dless of the 

sisting of both loca. and remote object, For example, ex- 

objects" location, Of course there ^^^^J^ , as k from executing a standalone program 

sToS^^^ 

tranparency flexibility is now described f °7"j°^^f, 1 WSfi|es 110Alnat collectively define the user interface, 
RefermgtoFigurel.the memory 106A,ncludesa^ 

me tho*anddataf.lesthatc^ 

program 150 (hereinafter referred to as the 'JWS ) JWS browser 154Aanc i a , g p 

fir specffication 112A. The JWS toolbar .pKArton ^^J^™ ^J^w^ 114A. 120A. 
cations 114A. web documents 120A, JWS applets ^^^S^^lcont (IAi) 162AI that are displayed 
1 40A, 1 48A specify the appearance ^ Uy element of the JWS user 

on thedisplaylOSA as elements ofaJWS^^^ 

«iesa.ink(s)118AitoaWebdo^ 

whenever the icon IAi is selected. The hnks 1 8A. can be , to file name that can be handled by the file 

(e .g. the computer 10 2A). in which case a nk ompnses a local path and ^ M Web 

service provided by the local operatmg ^<^^ J^S^, over the Internet by a conventional Web 
(e.g., documents stored on the computers 102B, 102C) that can b « *™ ve Weg a „ a m 1eature s of a 

browser. Because the JWS program t50A ^^^^Z^^^ to a particular icon IAi are 
conventional Web browser, it does not matter where J^J^^^ What is important to the preferred 
stored, nor does ftrr^er on vvhat type of Plat^ 

embodiment isthatthe JWS browser Internet, such as HTTP or FTP. If this is 

120A1 via one of the standard commun.catrons P r ^ ote t su P^° n D JLZd bv the JWS browser 154A (triggered by 
^Le,the linked Web dc.uments120Ai will be« 

the JWS program 1 50A) whenever ^^f^^^^^ to remote, executable document, 
would be required in the prior art to .mplement a ^^^S^L or remotely before being loaded into the 
Each Web document 120A (which could have mrtjally been <*"""™* or rcmo y mbdocumenX 
memory 106A) Eludes foments: ^^^TZ^r^^e a functional diction 
120A can also include embedded files (not ^ witn the link8 nBAi, the references *24Ai m 

between embedded and referenced files, nerthen « I h,s ^ handled by the JWS browser 154A 

the Web documents 120A can be to remote °r loca 9m. J^LSSSlol the present user interface is that a 
in the same manner as described for the hnks 118A . One s.gr£c*n * J*™** ^ a6SOcia ted with the icon 
reference124AicanbetoaJavaapp.et^ 
IAi v*ose related Web document^ 

^nthepreferredembod"^^^^^ 
app.etconLordir^imp^M 

embodiment, a spell checker .con IA1 could be ^linked vra a ™ D spell-checks the appropriate document 

downtoaded to the computer 102A ^ SllSi F« example an icon IA2 could be linked 

(s). Mematrvely. a Web document 1 1 20A. ^^^^^^^ applet so that both are 
to a Web document 120A2 that references a 
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Reterrinq to Figure 2 there is shown a data flow diagram illustrating the series of steps by which an applet is 
invoke!^ 

by the JWS browser 154A, which, fol.owing the selection of the ^ ™v 

specification file 114A1 Via the link 118A1, the icon IA1 is associated wrth the Web document 120A1, which is auto- 
%£XS£ executes any of the referenced files that are executable (i.e.. the applets) Jnth« example rt.sassu^ 
haune^r Z referenced executable, the applet 140A1. Once it is actrve. the applet 140A1 can take control of a 
portS oiLZpZ ' 108A (e.g.. the applet window 164A). on which it can display results, dialog boxes and icons that 
facilitate user interaction with the applet's functions and capabilities. 

Fteferrtng to Rgure 3, there is shown a data structure diagram setting out additional details of ^^-^f^l 
the memory 106 A Lt are used by the Java Workshop Program 150/1 These data ™ ^™ 
iTthatlfine the visual attributes 116Ai and Web document .inks 118Ai for icons .A, dispte b V l ^WS 150A 
on the too.bar 160. These eons (shown on Fig. 2) include a portfolio manager ,con IA1. pr 0) ect nonage c^A2. text 
eZoroiect icon IA3 build/compile icon IA4. source browse icon IA5. debug con IA6. run icon IA7 and help icon A8_ 
wlenie^the^ 

by the Java Workshop 150A for working with JWS portfolios and projects: 

provides access to the portfolio manager applet 140A1. which displays the projects in the current portfolio; 
provides access to the project manager applet 1 40A2. in which the user can edit project ^^ n ' 
provides access to a JWS text editor applet (not shown) in which the user can edrt project source code. 

,as- p^r 8 ™^ 

,A8: pS acSss to a JWS help applet (not shown) mat provides context-sensitive help for JWS operations. 

As described in reference to Figure 1 . in the preferred embodiment, an icon specification 114Ai includes alink to 
aWe^Tent 2^Ai that has a rLrence124Ai to a single applet 140Ai mat imptements the 

w^thec^^^^^ 

IA ^ sXdt a Web dSument CPortfofo.HTM") 120A1 that indudes a single reference 118A1 to the portfo.K> man- 
W^l^rSlifc the icon specification 1UA2. which is associated with the project manager ice* I A2 * 
Stad to a Web document (-ProjectHTW) 120A2 having a single reference 118A2 to the project manage applet 

Pr0i ^e methods 146Ai are made available to users as options on menus 147Ai that are displayed when their asso- 
H»tPH LoleVsTont selected For example, the portfolio managers methods 146A1 are displayed as opHons on a 
Crt^Cnu^ 

Many of the submenus 147Aij provided by the preferred embodiment; eg., the Project-Create. '^Cheese and 
Remove submenus l47A1a,147A1b,147A1c.147A1d and the Project->Create. Import. Choose. RemoveJ Run and 

SSZZS^IL^-^ can be app.fcd. For exampie. refemnglo F^t^ji-^ an 
instance of 1he Portfolio^Choose submenu 147A1c listing a set of portfolios (Portfolio 1. Portfolio 2, Portfolio 3) to 
£ Po^ChoTe^ethod 146A1c. Figure 4 also show the portfolio menu 147A1 .feting the portfol* manager 

poin^ui r Skig wSh their respective menus 147Ai and submenus 147Aij. Most cf "^JJJJJ^" 
the methods of the portfolio and project manager applets 114A1 , 114A2. wh,ch are key elements of the JWS 150A. 

Portfolio Manager Methods 

The portfolio manager applet 140A1 provides four methods 146A1 that respectively allow a user of the JWS 1 150A 
to 'C?ite° iS "fmport- 146A1b. -Choose' 146A1c and -Remove" 146A1d portfolios. Each of these methods 
46 A Ta^is es Z respective task by interacting with a set of porttoito files 160AI. each of jjich « 
onTe local orremote systems and represents one portfolio. As shown in Figure 3. a gener.cportfolK,f.le160A includes 



50 



S5 



5 



EP 0 798 655 A2 



oresent invention, a project reference ib^Ai can ucwa j #- 
Lname^ortoaW^^ 

For example, referring to Figure 5, there is snown nmaram a Java "Package', an 'Image' and a 

tor U constituent projects, which Mud. an '^^.^^^SZ k^T^tory in\he memory 106A 
•Remote" applet, ail o, which are local userandtheir 
Because these projects are all stored in the user's home ™" J" fof erence , 62A1a to ^ applet 

corresponding project files can be referenced by oath and ^^^ e ^ nce 162Anf (/lib ,SemiRemote. 
project file 170A1 b «PP le ^ J^^T.^d!w on machine A and a reference 

can onfy be accessed over the Internet using th ^ b ^ e ™er has a personal portfoto (with a corresponding 

Referringagain to Figures, mmep^^ 
portfolio file 1 60Ai) that contains only the projects i«ft ^C^tf ol^^ u2no the^orHolio manager's "Choose* method/ 
'brings up the persona. por.fo.to as ^^J^^^^'ffS, A use' does thfe by selecting 
option 146A1C the user can choose another ^^^^^ detonates the Choose submenu that is displayed by 
fTom the Portto.io->Choose s^"^™^ 147A1) - available 

the JWS 150A following the user's selection f ^^^^L ™™ remoU}) ^ user can then view the projects 
portfolios, the desired portfolio* We name (rht » ^"^^,^^,,^^180. In this and other 
composingthecurrentr^r^ 

situations described herein, the applet being executed d *P'X?^ "cVeate" option and then 

A user of the JWS 150A can create a new portfoto by seleding ^^^^Create method 1 46A1 a, 
enteringthemaneoltheportfc*^ 

which creates thecorrespondingr^^^^ ^ portfolio has no 

the portfolio's name to the Choose ^^SiSSSSS ubmlnu \ 4^ (described" below) or import exiting 
projects, but the user can add projects in ^S^^SnS^Lo desc ibed below). Once the new portfolio 
projects into the portfolio with the P«^^^ J^* 7 ^S^to be accessed by others, 
has been created, its creator can keep rl private or can publish it on the ) ™« to J c To 

A user can a.so import existing portfolios that ^^^J^SS^S^M . This triggers the 
import such a portfolio, the user first selects the Import. optnn hstedor thePortf J» ™™ m 

name or URL of the portfolio to be imported and art mnpon Dimo portfoijo^Chcose and Portfolio->Re- 

.„,^. ,n „spons. «. £A «^J^^*S*SS.«. «>» 
move submenus 147A1C 147A14 Tne JWi 1M" ' wim like any other portfolio. 

It is on Ins Portfolio.>Chooe 9 submenu 147A1C lb. "^^^^f^t^L^ submenu. » 
A user ran remov. a portfolio by select.*, ft. pc*to» « ^™^''3^; a , eraW; , et ,p on iolioliomtt.. 

applet tag for the applet project. 

s Thisinformationdeter^^^ 

on a particular project. These project methods 146A2 are now described. 
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or a remote project. To create any ot these projects, the user nrsi onooses w 

displayed on n. submenu). Th. user than spec*., th. » » tZTSLSto. «~ *•» 

I.=rnrxr^^^^ 

enter attributes associated with the image, such as: 

(1) the image's aiignment wfth respect to surrounding text (e.g.. cho***!^ alignment causes a browser 
diUng the image -<^^^ 

(2) whether the image is active (meaning that a person viewiny u w miay 
Onee.h.use.ha.nlWin.bieNonn^^ 

,h. pomelo Ihey »*h <o be the cw-en, portoUo. LS^^SSt- Is displayed by «» 

ft. nan. «URLoMh. p^oUO b^J*- £J» ^^^^ an ^ bu«on olsp^yeo 
Pro ect->lmport method 146A2b. After entenngineni™ , designated project into the current 

on the import page 147A2b. upon wh.ch the roport ™«£**?b ^^d^SSLue 147A2c. 147A2d. 

IA1 from the toolbar 160. . th - b -choosing" the current 
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by CicKng on -Apply- The create me** 146A2 J? 

run page URL field 184Ai that is set to the URL * HTML page to (w^corr^unApplet* Mm") of 
Figure 5. the remote project file 170A5 has a run W^fJ^^^J^d 146A2also adds the name 
the Webpage (-RunApp.et^tm-) that «^^Z 1^he JwsT^en makes the imported project 
of the project file l70Ai to the current portfolio '^^rseleTs the current project to be displayed by the Portfolio 

page (http://C.com/RunApplet2.htm) and runs the remote applet (Applet2) be 

P „ a user does not specHy a Run page URL 184A, .n ^'^^^ generates 
run using the Projection method 146A2f. '"^^^ user on 

anew Web page that contahs an applet tag cre^ed^ 

anHTMLfifcthatexecutesthea^ 

user does this by first Meeting (singte^ng^ 

option from the Project menu 1 47A2. This set o acfions causes me Copy * py ^ 

w*h other newprojects, the JWS150Aa*te^^ 

and add to the HTML file tags referencing the copied applet d can 

General information about the project, including name, type and source directory 

Build information needed to compile the project 

DebucyBrowse Information needed to debug and browse source files _ 
nun information needed to execute an applet or standalone program in the JWS Browser, 

Publish information needed to allow the project to be copied by other users; and 

PoSl iS> information needed to display the project in the Portf oho Manager. 
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of a project to indicate certain attributes of a project that are relevant to publication ™" 
publication attributes are contained in the Publish and PorUofeo Folders, wh,ch include the following fields. 

Portfolio Folder 

Description a brief description of the project that is dispfeyed by the JWS Browser when the mouse is 

cositioned over the project image in the Portfolio Manager, 

the LIRL for the ima'ge fi.e (GIF. JPEG, or other) *" 
portfolio (If no image file is specified, a default GIF file » used by the JWS ISOA^ and 
fee general characteristics of the project, for example, whether the project » video, graphics 

or audio. 



Portfolio image URL 
Features 



Publish Folder 



i a lonniP field with two values (YES/NO) that controls whether the project's 

Distribu.esourcecop.es ^f^^^ 

(when this field is set to NO. the JWS only allows the corresponding project tiles 
170Ai to be copied absent the contents 182A); and 
Submitter Name, E-Maii and URL The name, e-mai. address and Web page of the person adding the pro,ect to 

the portfolio. 

JWS 150A. Portfolio 1 is a tocal PJ™"^ " •» • t p2a . h n j, a re mote portfolio 

projects all are manipulable in the same fashion in the JWS 150A. accBSS es the com- 

Portfolio 2 is a remote portfolio whose components are also stored remotely. The JWS 150A accesses tne com 
^teTpM^toZxeneX using theJWS browser 154A but displays Portfolio 2 in the same manner as 
ESSL? Not aha! HoS portfolo such as Portfolb 1 could aiso reference oniy remotely stored projects (e.g.. 
Portfoho 1 N ° l ° * P"JJ C a S of ^ 150A seamlessly to organize projects and portfolios that may 

D e°S™^ 

awareness of the present embodiment aiso enables users to publish the.rown portfolios so they can be accessed ana 
used by others over the Internet. 

Claims 

1 in a first computer having a display and a memory, said first computer being networked with a set of remote cor* 
u^a^tem for iniing frorn a graph**, user interface displayed on ,sa W ** 

execution of compound documents whose components are not consumed to exist solely art said computer, said 
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system comprising: 

adisplayabletootoarhavingaset of selectable icons, each icon being associated wrth one a more operations 

Lid l^being selected from a .ocal M when said document is stored on sa,d computer or a network He 
when said document is stored on said remote computers; and / .^ lltar ,„ ^ sa id files 

Tbrowser that is configured, when one of said icons is selected, to cause sa.d computer to load said Wes 
rZZSZ* Ts2d Id ocuments associated with the selected icon via said set of links and execute any of the 
loaded files that are executable, thereby initiating the operation associated wrth said icon. 

The system of claim 1. wherein said applets are written in a platform independent computer language that is 
interpreted and executed in a virtual machine implemented by said browser. 

The system of claim 2. wherein said platform independent computer language is Java, 
location is remote. 

ThP svstem of claim 4 wherem said HTML document includes a single reference to an applet that coordinate^ all 
system interactions associated with the selected icon. 

t l« w i« 8 LocW^.ppleII S »«=«».»W^«^ Mbe1n S^ m "^" M ' 0 ^' dSOlelV ™ 

first computer. 

The svstem of claim 6 wherem each of said input files stored remotely to said first computer is referenced by a 
ML in i P 7sp^fica.ion file and each of said input fi.es stored on said firs, computer • referenced by a 

local path and file name. 

A method for initialing from a graphfca. user Werface delayed on a ^^^SSS^TSK 
compound documents whose components are not consumed to exist solely on 8 ^ s ^P U, 2 jd ^ a e ; od 
Srn^er being networked withaset of remote computers that can hostasubset of sad components, sari method 

comprising the steps of: 

displaying a toolbar having a set of selectable icons, each icon being associated with ^ more ^"T 
fna? are inftiated via selection of said icon and being linked to one or more <™^^Z™eTJi 
!£Lh incudes a set of references to components, or files, that are needed to carry out one or more of said 
a^ooi^ acr, of a subset of sa W files having a file type selected from an applet or a datafile. 

uprio^s 

u^S. loading saW one or more compound documents, loading safcl files referenced in said compound docu- 
ments said files not being constrained to exist solely on said first computer; and 

iraSdeo^letasaty'pethat is selected from an applet or a standalone application, executmgsa.dtoaded 



7. 



file. 



9 The method of claim 8. wherein said applets are written in a platform independent computer language that is 
interpreted and executed hi a virtual machine implemented by said browser. 

10. ThemethodofclaimB.vvhereinsa^ 
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whenacompounddoeuminito^ 

.«ino a local oath and file name provided for said compound document in said link; ana 

21 a 1£££^» t* loaded is stored on one of said remote computers, issumg a dc*ument 

5 for said compound document in said link. 

11. The method of claim 10, wherein said step of loading said files comprises the steps of: 

when a referenced file is stored on said first computer, retrieving said referenced file using a local path and 

io fi| e name provided for said referenced file in said reference; and 

wSen a referenced file is stored oh one of said remote computers, issuing a document request message for 
XZSZSZ ove^network using a network node and file name provided for said referenced file m 

said reference. 

is 12 The method of claim 11 wherein said compound document is an HTML document and wherein each of said ref- 

a .oca. reference ihen safcf referenced file is store* on said first computer or a unreal 
resource locator (URL) when said referenced file is stored on one of said set of remote computers. 

13. The method of claim 12, wherein: 
20 saidHTMLdocumentincludesasinglereferencetoanappletthatccordinatesallofsaidoperat^ 

2Td stepiTli and executing comprise leading and executing said applet, whteh thereby coordinates 
and controls all operations and user and system interactions associated wrth the selected .con. 
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